Goto

Collaborating Authors

 kafka data pipeline


Kafka Data Pipelines for Machine Learning Enterprise Applications

#artificialintelligence

As illustrated in the above deployment diagram, in Step 1, the client sends the platform a request. The request has the pipeline function name and the input parameter values of the function. The request gets placed in the Kafka Topic, "ml.pipeline.input", In step 3, the message gets picked up by a node in the ML cluster. In step 4, the pipeline executor of the ML node builds out the pipeline function as an expression using the message.